{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"NLU_training_multi_lingual_multi_class_text_classifier_demo_hotel_reviews.ipynb","provenance":[],"collapsed_sections":["zkufh760uvF3"]},"kernelspec":{"name":"python3","display_name":"Python 3"}},"cells":[{"cell_type":"markdown","metadata":{"id":"zkufh760uvF3"},"source":["![JohnSnowLabs](https://nlp.johnsnowlabs.com/assets/images/logo.png)\n","\n","[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/nlu/blob/master/examples/colab/Training/multi_lingual/multi_class_text_classification/NLU_training_multi_lingual_multi_class_text_classifier_demo_hotel_reviews.ipynb)\n","\n","\n","\n","# Training a Deep Learning Classifier with NLU \n","## ClassifierDL (Multi-class Text Classification)\n","## 3 class Tripadvisor Hotel review classifier training\n","With the [ClassifierDL model](https://nlp.johnsnowlabs.com/docs/en/annotators#classifierdl-multi-class-text-classification) from Spark NLP you can achieve State Of the Art results on any multi class text classification problem \n","\n","This notebook showcases the following features : \n","\n","- How to train the deep learning classifier\n","- How to store a pipeline to disk\n","- How to load the pipeline from disk (Enables NLU offline mode)\n","\n","You can achieve these results or even better on this dataset with training data :\n","\n","<br>\n","\n","![image.png]()\n","\n","\n","You can achieve these results or even better on this dataset with test data :\n","\n","<br>\n","\n","\n","![image.png]()"]},{"cell_type":"markdown","metadata":{"id":"dur2drhW5Rvi"},"source":["# 1. Install Java 8 and NLU"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"dTyEf8lNWMi7","executionInfo":{"status":"ok","timestamp":1620195568586,"user_tz":-300,"elapsed":116506,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"9c394263-780b-4e46-9b97-406bd3a67225"},"source":["!wget https://setup.johnsnowlabs.com/nlu/colab.sh -O - | bash\n","  \n","\n","import nlu"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 06:17:34--  https://raw.githubusercontent.com/JohnSnowLabs/nlu/master/scripts/colab_setup.sh\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 1671 (1.6K) [text/plain]\n","Saving to: ‘STDOUT’\n","\n","\r-                     0%[                    ]       0  --.-KB/s               \r-                   100%[===================>]   1.63K  --.-KB/s    in 0s      \n","\n","2021-05-05 06:17:34 (33.3 MB/s) - written to stdout [1671/1671]\n","\n","Installing  NLU 3.0.0 with  PySpark 3.0.2 and Spark NLP 3.0.1 for Google Colab ...\n","\u001b[K     |████████████████████████████████| 204.8MB 68kB/s \n","\u001b[K     |████████████████████████████████| 153kB 40.2MB/s \n","\u001b[K     |████████████████████████████████| 204kB 18.6MB/s \n","\u001b[K     |████████████████████████████████| 204kB 37.1MB/s \n","\u001b[?25h  Building wheel for pyspark (setup.py) ... \u001b[?25l\u001b[?25hdone\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"f4KkTfnR5Ugg"},"source":["# 2. Download hotel reviews  dataset \n","https://www.kaggle.com/andrewmvd/trip-advisor-hotel-reviews\n","\n","Hotels play a crucial role in traveling and with the increased access to information new pathways of selecting the best ones emerged.\n","With this dataset, consisting of 20k reviews crawled from Tripadvisor, you can explore what makes a great hotel and maybe even use this model in your travels!\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"OrVb5ZMvvrQD","executionInfo":{"status":"ok","timestamp":1620195570511,"user_tz":-300,"elapsed":118409,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"a9ccf638-b1d8-40e6-d4d5-59bc7bc923c3"},"source":["! wget http://ckl-it.de/wp-content/uploads/2021/02/tripadvisor_hotel_reviews_multi_lingual.csv\n"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 06:19:28--  http://ckl-it.de/wp-content/uploads/2021/02/tripadvisor_hotel_reviews_multi_lingual.csv\n","Resolving ckl-it.de (ckl-it.de)... 217.160.0.108, 2001:8d8:100f:f000::209\n","Connecting to ckl-it.de (ckl-it.de)|217.160.0.108|:80... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 5332717 (5.1M) [text/csv]\n","Saving to: ‘tripadvisor_hotel_reviews_multi_lingual.csv’\n","\n","tripadvisor_hotel_r 100%[===================>]   5.08M  3.76MB/s    in 1.4s    \n","\n","2021-05-05 06:19:30 (3.76 MB/s) - ‘tripadvisor_hotel_reviews_multi_lingual.csv’ saved [5332717/5332717]\n","\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":419},"id":"y4xSRWIhwT28","executionInfo":{"status":"ok","timestamp":1620195571230,"user_tz":-300,"elapsed":119050,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"ed564426-69ae-4fed-b76f-13e3db7bc103"},"source":["import pandas as pd\n","test_path = '/content/tripadvisor_hotel_reviews_multi_lingual.csv'\n","train_df = pd.read_csv(test_path,sep=\",\")\n","cols = [\"y\",\"text\"]\n","train_df = train_df[cols]\n","from sklearn.model_selection import train_test_split\n","train_df = train_df.iloc[:1500]\n","train_df, test_df = train_test_split(train_df, test_size=0.2)\n","train_df\n","\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>y</th>\n","      <th>text</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>819</th>\n","      <td>great</td>\n","      <td>wonderful weekend fairmont copley plaza enjoye...</td>\n","    </tr>\n","    <tr>\n","      <th>338</th>\n","      <td>great</td>\n","      <td>nice stayed silver cloud pre-cruise, impressed...</td>\n","    </tr>\n","    <tr>\n","      <th>556</th>\n","      <td>great</td>\n","      <td>best deal town n't mind shabby lobby moore hot...</td>\n","    </tr>\n","    <tr>\n","      <th>1057</th>\n","      <td>great</td>\n","      <td>great experience just got rio mar yesterday mi...</td>\n","    </tr>\n","    <tr>\n","      <th>400</th>\n","      <td>poor</td>\n","      <td>hospital stayed 2 weeks got sick stomach upset...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>1410</th>\n","      <td>great</td>\n","      <td>great time westin rio mar, know like reading r...</td>\n","    </tr>\n","    <tr>\n","      <th>1283</th>\n","      <td>poor</td>\n","      <td>different used stayed el san juan total 5 time...</td>\n","    </tr>\n","    <tr>\n","      <th>1133</th>\n","      <td>average</td>\n","      <td>modern hilton good location stay area pretty r...</td>\n","    </tr>\n","    <tr>\n","      <th>1207</th>\n","      <td>average</td>\n","      <td>nothing spectacular chosen weekend getaway bui...</td>\n","    </tr>\n","    <tr>\n","      <th>486</th>\n","      <td>average</td>\n","      <td>avoid summer, stayed intercity times wrote fav...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>1200 rows × 2 columns</p>\n","</div>"],"text/plain":["            y                                               text\n","819     great  wonderful weekend fairmont copley plaza enjoye...\n","338     great  nice stayed silver cloud pre-cruise, impressed...\n","556     great  best deal town n't mind shabby lobby moore hot...\n","1057    great  great experience just got rio mar yesterday mi...\n","400      poor  hospital stayed 2 weeks got sick stomach upset...\n","...       ...                                                ...\n","1410    great  great time westin rio mar, know like reading r...\n","1283     poor  different used stayed el san juan total 5 time...\n","1133  average  modern hilton good location stay area pretty r...\n","1207  average  nothing spectacular chosen weekend getaway bui...\n","486   average  avoid summer, stayed intercity times wrote fav...\n","\n","[1200 rows x 2 columns]"]},"metadata":{"tags":[]},"execution_count":3}]},{"cell_type":"markdown","metadata":{"id":"0296Om2C5anY"},"source":["# 3. Train Deep Learning Classifier using nlu.load('train.classifier')\n","\n","You dataset label column should be named 'y' and the feature column with text data should be named 'text'"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":1000},"id":"3ZIPkRkWftBG","executionInfo":{"status":"ok","timestamp":1620198160598,"user_tz":-300,"elapsed":2708392,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"6352b01c-81ce-4d7c-851e-231b12fecd36"},"source":["trainable_pipe = nlu.load('xx.embed_sentence.labse train.classifier')\n","# We need to train longer and user smaller LR for NON-USE based sentence embeddings usually\n","# We could tune the hyperparameters further with hyperparameter tuning methods like gridsearch\n","# Also longer training gives more accuracy\n","trainable_pipe['trainable_classifier_dl'].setMaxEpochs(60)  \n","trainable_pipe['trainable_classifier_dl'].setLr(0.005) \n","fitted_pipe = trainable_pipe.fit(train_df)\n","# predict with the trainable pipeline on dataset and get predictions\n","preds = fitted_pipe.predict(train_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","from sklearn.metrics import classification_report\n","print(classification_report(preds['y'], preds['classifier_dl']))\n","\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["labse download started this may take some time.\n","Approximate size to download 1.7 GB\n","[OK!]\n","sentence_detector_dl download started this may take some time.\n","Approximate size to download 354.6 KB\n","[OK!]\n","              precision    recall  f1-score   support\n","\n","     average       0.75      0.78      0.77       396\n","       great       0.86      0.91      0.88       391\n","        poor       0.88      0.79      0.83       413\n","\n","    accuracy                           0.83      1200\n","   macro avg       0.83      0.83      0.83      1200\n","weighted avg       0.83      0.83      0.83      1200\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>y</th>\n","      <th>origin_index</th>\n","      <th>text</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.042161960154771805, 0.0009784834692254663, ...</td>\n","      <td>great</td>\n","      <td>wonderful weekend fairmont copley plaza enjoye...</td>\n","      <td>[wonderful weekend fairmont copley plaza enjoy...</td>\n","      <td>0.999989</td>\n","      <td>great</td>\n","      <td>819</td>\n","      <td>wonderful weekend fairmont copley plaza enjoye...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>[0.028560785576701164, 0.076837457716465, -0.0...</td>\n","      <td>great</td>\n","      <td>nice stayed silver cloud pre-cruise, impressed...</td>\n","      <td>[nice stayed silver cloud pre-cruise, impresse...</td>\n","      <td>0.999971</td>\n","      <td>great</td>\n","      <td>338</td>\n","      <td>nice stayed silver cloud pre-cruise, impressed...</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>[-0.04284599423408508, 0.031210748478770256, -...</td>\n","      <td>poor</td>\n","      <td>best deal town n't mind shabby lobby moore hot...</td>\n","      <td>[best deal town n't mind shabby lobby moore ho...</td>\n","      <td>0.651085</td>\n","      <td>great</td>\n","      <td>556</td>\n","      <td>best deal town n't mind shabby lobby moore hot...</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>[-0.0364091582596302, 0.006750240921974182, 0....</td>\n","      <td>great</td>\n","      <td>great experience just got rio mar yesterday mi...</td>\n","      <td>[great experience just got rio mar yesterday m...</td>\n","      <td>0.998592</td>\n","      <td>great</td>\n","      <td>1057</td>\n","      <td>great experience just got rio mar yesterday mi...</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>[-0.01341036893427372, 0.01906048320233822, 0....</td>\n","      <td>poor</td>\n","      <td>hospital stayed 2 weeks got sick stomach upset...</td>\n","      <td>[hospital stayed 2 weeks got sick stomach upse...</td>\n","      <td>0.999999</td>\n","      <td>poor</td>\n","      <td>400</td>\n","      <td>hospital stayed 2 weeks got sick stomach upset...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>1195</th>\n","      <td>[-0.07303472608327866, -0.0014495996292680502,...</td>\n","      <td>great</td>\n","      <td>great time westin rio mar, know like reading r...</td>\n","      <td>[great time westin rio mar, know like reading ...</td>\n","      <td>0.999355</td>\n","      <td>great</td>\n","      <td>1410</td>\n","      <td>great time westin rio mar, know like reading r...</td>\n","    </tr>\n","    <tr>\n","      <th>1196</th>\n","      <td>[-0.04543023928999901, 0.040597811341285706, -...</td>\n","      <td>poor</td>\n","      <td>different used stayed el san juan total 5 time...</td>\n","      <td>[different used stayed el san juan total 5 tim...</td>\n","      <td>0.999191</td>\n","      <td>poor</td>\n","      <td>1283</td>\n","      <td>different used stayed el san juan total 5 time...</td>\n","    </tr>\n","    <tr>\n","      <th>1197</th>\n","      <td>[-0.020267890766263008, 0.05014576390385628, -...</td>\n","      <td>average</td>\n","      <td>modern hilton good location stay area pretty r...</td>\n","      <td>[modern hilton good location stay area pretty ...</td>\n","      <td>0.999984</td>\n","      <td>average</td>\n","      <td>1133</td>\n","      <td>modern hilton good location stay area pretty r...</td>\n","    </tr>\n","    <tr>\n","      <th>1198</th>\n","      <td>[-0.019527727738022804, 0.05594026297330856, -...</td>\n","      <td>average</td>\n","      <td>nothing spectacular chosen weekend getaway bui...</td>\n","      <td>[nothing spectacular chosen weekend getaway bu...</td>\n","      <td>0.998562</td>\n","      <td>average</td>\n","      <td>1207</td>\n","      <td>nothing spectacular chosen weekend getaway bui...</td>\n","    </tr>\n","    <tr>\n","      <th>1199</th>\n","      <td>[-0.013655068352818489, -0.007150351535528898,...</td>\n","      <td>average</td>\n","      <td>avoid summer, stayed intercity times wrote fav...</td>\n","      <td>[avoid summer, stayed intercity times wrote fa...</td>\n","      <td>0.952325</td>\n","      <td>average</td>\n","      <td>486</td>\n","      <td>avoid summer, stayed intercity times wrote fav...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>1200 rows × 8 columns</p>\n","</div>"],"text/plain":["                               sentence_embedding_labse  ...                                               text\n","0     [0.042161960154771805, 0.0009784834692254663, ...  ...  wonderful weekend fairmont copley plaza enjoye...\n","1     [0.028560785576701164, 0.076837457716465, -0.0...  ...  nice stayed silver cloud pre-cruise, impressed...\n","2     [-0.04284599423408508, 0.031210748478770256, -...  ...  best deal town n't mind shabby lobby moore hot...\n","3     [-0.0364091582596302, 0.006750240921974182, 0....  ...  great experience just got rio mar yesterday mi...\n","4     [-0.01341036893427372, 0.01906048320233822, 0....  ...  hospital stayed 2 weeks got sick stomach upset...\n","...                                                 ...  ...                                                ...\n","1195  [-0.07303472608327866, -0.0014495996292680502,...  ...  great time westin rio mar, know like reading r...\n","1196  [-0.04543023928999901, 0.040597811341285706, -...  ...  different used stayed el san juan total 5 time...\n","1197  [-0.020267890766263008, 0.05014576390385628, -...  ...  modern hilton good location stay area pretty r...\n","1198  [-0.019527727738022804, 0.05594026297330856, -...  ...  nothing spectacular chosen weekend getaway bui...\n","1199  [-0.013655068352818489, -0.007150351535528898,...  ...  avoid summer, stayed intercity times wrote fav...\n","\n","[1200 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":4}]},{"cell_type":"markdown","metadata":{"id":"_1jxw3GnVGlI"},"source":["# 3.1 evaluate on Test Data"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"Fxx4yNkNVGFl","executionInfo":{"status":"ok","timestamp":1620198282249,"user_tz":-300,"elapsed":2830029,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"5ae17df4-2e52-413a-b381-1192861af2d2"},"source":["preds = fitted_pipe.predict(test_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['classifier_dl']))"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","     average       0.53      0.56      0.54        98\n","       great       0.75      0.77      0.76       103\n","        poor       0.72      0.66      0.69        99\n","\n","    accuracy                           0.66       300\n","   macro avg       0.67      0.66      0.66       300\n","weighted avg       0.67      0.66      0.66       300\n","\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"yUkk_L8MGcRg"},"source":["#4.  Test Model  with  20 languages!"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":980},"id":"q2s6nsZZGcRm","executionInfo":{"status":"ok","timestamp":1620198329116,"user_tz":-300,"elapsed":2876883,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"389e674f-fe0f-4740-f47a-5c27bc22e02a"},"source":["train_df = pd.read_csv(\"tripadvisor_hotel_reviews_multi_lingual.csv\")\n","preds = fitted_pipe.predict(train_df[[\"test_sentences\",\"y\"]].iloc[:100],output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['classifier_dl']))\n","\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","     average       0.41      0.55      0.47        33\n","       great       0.66      0.66      0.66        35\n","        poor       0.81      0.53      0.64        32\n","\n","    accuracy                           0.58       100\n","   macro avg       0.63      0.58      0.59       100\n","weighted avg       0.62      0.58      0.59       100\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>y</th>\n","      <th>origin_index</th>\n","      <th>text</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.013124360702931881, -0.010088308714330196,...</td>\n","      <td>average</td>\n","      <td>Tolles Hotel 5 Nächte Ende August 2005. Reserv...</td>\n","      <td>[Tolles Hotel 5 Nächte Ende August 2005., Rese...</td>\n","      <td>0.993889</td>\n","      <td>great</td>\n","      <td>0</td>\n","      <td>Tolles Hotel 5 Nächte Ende August 2005. Reserv...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>[0.021132875233888626, 0.06491417437791824, -0...</td>\n","      <td>average</td>\n","      <td>தூண்டில் மற்றும் சுவிட்ச் அறை விகிதங்கள், ஏற்ற...</td>\n","      <td>[தூண்டில் மற்றும் சுவிட்ச் அறை விகிதங்கள், ஏற்...</td>\n","      <td>0.884120</td>\n","      <td>poor</td>\n","      <td>1</td>\n","      <td>தூண்டில் மற்றும் சுவிட்ச் அறை விகிதங்கள், ஏற்ற...</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>[-0.014877039939165115, 0.08078614622354507, -...</td>\n","      <td>average</td>\n","      <td>បន្ទប់ឆែកល្អចូលចិត្តសណ្ឋាគារទីតាំងល្អមិត្តភាព។...</td>\n","      <td>[បន្ទប់ឆែកល្អចូលចិត្តសណ្ឋាគារទីតាំងល្អមិត្តភាព...</td>\n","      <td>0.999971</td>\n","      <td>average</td>\n","      <td>2</td>\n","      <td>បន្ទប់ឆែកល្អចូលចិត្តសណ្ឋាគារទីតាំងល្អមិត្តភាព។...</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>[-0.051047880202531815, 0.04952175170183182, -...</td>\n","      <td>great</td>\n","      <td>beste Lage Wert Eigenschaften Waikiki Kopf Hot...</td>\n","      <td>[beste Lage Wert Eigenschaften Waikiki Kopf Ho...</td>\n","      <td>0.995766</td>\n","      <td>great</td>\n","      <td>3</td>\n","      <td>beste Lage Wert Eigenschaften Waikiki Kopf Hot...</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>[-0.04287628456950188, 0.011480937711894512, -...</td>\n","      <td>poor</td>\n","      <td>botel not recommended little disappointed hone...</td>\n","      <td>[botel not recommended little disappointed hon...</td>\n","      <td>0.999344</td>\n","      <td>poor</td>\n","      <td>4</td>\n","      <td>botel not recommended little disappointed hone...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>95</th>\n","      <td>[-0.0008096122182905674, 0.03655293583869934, ...</td>\n","      <td>average</td>\n","      <td>موقع رائع قضى 7 أيام في نزل القلعة في بداية ال...</td>\n","      <td>[موقع رائع قضى 7 أيام في نزل القلعة في بداية ا...</td>\n","      <td>0.998497</td>\n","      <td>great</td>\n","      <td>95</td>\n","      <td>موقع رائع قضى 7 أيام في نزل القلعة في بداية ال...</td>\n","    </tr>\n","    <tr>\n","      <th>96</th>\n","      <td>[-0.005492118652909994, 0.05503822863101959, -...</td>\n","      <td>great</td>\n","      <td>super emplacement les lits durs ont vraiment a...</td>\n","      <td>[super emplacement les lits durs ont vraiment ...</td>\n","      <td>0.999948</td>\n","      <td>average</td>\n","      <td>96</td>\n","      <td>super emplacement les lits durs ont vraiment a...</td>\n","    </tr>\n","    <tr>\n","      <th>97</th>\n","      <td>[0.009459477849304676, 0.006773392669856548, -...</td>\n","      <td>average</td>\n","      <td>ทำเลที่ตั้งดีเยี่ยมโรงแรมที่สมบูรณ์แบบตรงกลางน...</td>\n","      <td>[ทำเลที่ตั้งดีเยี่ยมโรงแรมที่สมบูรณ์แบบตรงกลาง...</td>\n","      <td>0.986078</td>\n","      <td>great</td>\n","      <td>97</td>\n","      <td>ทำเลที่ตั้งดีเยี่ยมโรงแรมที่สมบูรณ์แบบตรงกลางน...</td>\n","    </tr>\n","    <tr>\n","      <th>98</th>\n","      <td>[-0.06341180950403214, 0.03327464684844017, -0...</td>\n","      <td>average</td>\n","      <td>gerade anfangen, Glanz zu verlieren, blieb Kan...</td>\n","      <td>[gerade anfangen, Glanz zu verlieren, blieb Ka...</td>\n","      <td>0.793590</td>\n","      <td>great</td>\n","      <td>98</td>\n","      <td>gerade anfangen, Glanz zu verlieren, blieb Kan...</td>\n","    </tr>\n","    <tr>\n","      <th>99</th>\n","      <td>[0.02874639444053173, -0.009642799384891987, -...</td>\n","      <td>poor</td>\n","      <td>bittersweet यादें शानदार अतीत में हाल ही में र...</td>\n","      <td>[bittersweet यादें शानदार अतीत में हाल ही में ...</td>\n","      <td>0.999651</td>\n","      <td>poor</td>\n","      <td>99</td>\n","      <td>bittersweet यादें शानदार अतीत में हाल ही में र...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>100 rows × 8 columns</p>\n","</div>"],"text/plain":["                             sentence_embedding_labse  ...                                               text\n","0   [-0.013124360702931881, -0.010088308714330196,...  ...  Tolles Hotel 5 Nächte Ende August 2005. Reserv...\n","1   [0.021132875233888626, 0.06491417437791824, -0...  ...  தூண்டில் மற்றும் சுவிட்ச் அறை விகிதங்கள், ஏற்ற...\n","2   [-0.014877039939165115, 0.08078614622354507, -...  ...  បន្ទប់ឆែកល្អចូលចិត្តសណ្ឋាគារទីតាំងល្អមិត្តភាព។...\n","3   [-0.051047880202531815, 0.04952175170183182, -...  ...  beste Lage Wert Eigenschaften Waikiki Kopf Hot...\n","4   [-0.04287628456950188, 0.011480937711894512, -...  ...  botel not recommended little disappointed hone...\n","..                                                ...  ...                                                ...\n","95  [-0.0008096122182905674, 0.03655293583869934, ...  ...  موقع رائع قضى 7 أيام في نزل القلعة في بداية ال...\n","96  [-0.005492118652909994, 0.05503822863101959, -...  ...  super emplacement les lits durs ont vraiment a...\n","97  [0.009459477849304676, 0.006773392669856548, -...  ...  ทำเลที่ตั้งดีเยี่ยมโรงแรมที่สมบูรณ์แบบตรงกลางน...\n","98  [-0.06341180950403214, 0.03327464684844017, -0...  ...  gerade anfangen, Glanz zu verlieren, blieb Kan...\n","99  [0.02874639444053173, -0.009642799384891987, -...  ...  bittersweet यादें शानदार अतीत में हाल ही में र...\n","\n","[100 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":6}]},{"cell_type":"markdown","metadata":{"id":"RjtuNUcvuJTT"},"source":["# The Model understands Englsih\n","![en](https://www.worldometers.info/img/flags/small/tn_nz-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"o0vu7PaWkcI7","executionInfo":{"status":"ok","timestamp":1620198331127,"user_tz":-300,"elapsed":2878867,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"b9a0a2fb-0f1b-402f-e45c-8532767633d7"},"source":["fitted_pipe.predict(\"It was the best stay of my life, I loved it!! \")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.025105198845267296, -0.0444340780377388, -0...</td>\n","      <td>great</td>\n","      <td>It was the best stay of my life, I loved it!!</td>\n","      <td>[It was the best stay of my life, I loved it!, !]</td>\n","      <td>0.999519</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.025105198845267296, -0.0444340780377388, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":7}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"1ykjRQhCtQ4w","executionInfo":{"status":"ok","timestamp":1620198332354,"user_tz":-300,"elapsed":2880072,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"b9b37106-be3b-4bc2-ad8d-984ec72be447"},"source":["fitted_pipe.predict(\"It was the worst stay of my life, I hated it!! \")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.02957884594798088, -0.042081158608198166, -...</td>\n","      <td>poor</td>\n","      <td>It was the worst stay of my life, I hated it!!</td>\n","      <td>[It was the worst stay of my life, I hated it!...</td>\n","      <td>0.997514</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.02957884594798088, -0.042081158608198166, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":8}]},{"cell_type":"markdown","metadata":{"id":"vohym-XbuNHn"},"source":["# The Model understands German\n","![de](https://www.worldometers.info/img/flags/small/tn_gm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"dzaaZrI4tVWc","executionInfo":{"status":"ok","timestamp":1620198332759,"user_tz":-300,"elapsed":2880425,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"bd46e5c1-d196-42f5-f714-8d6abe96d7cc"},"source":["# German for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Es war der beste Aufenthalt meines Lebens, ich habe es geliebt !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.025617901235818863, -0.050006747245788574, ...</td>\n","      <td>great</td>\n","      <td>Es war der beste Aufenthalt meines Lebens, ich...</td>\n","      <td>[Es war der beste Aufenthalt meines Lebens, ic...</td>\n","      <td>0.999732</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.025617901235818863, -0.050006747245788574, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":9}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"BbhgTSBGtTtJ","executionInfo":{"status":"ok","timestamp":1620198333653,"user_tz":-300,"elapsed":2881288,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"7e47b6b4-ae79-4638-bff1-f3ce7c6cafdb"},"source":["\t\t\n","# German for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Es war der schlimmste Aufenthalt meines Lebens, ich hasste es !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.022492462769150734, -0.05308641120791435, -...</td>\n","      <td>poor</td>\n","      <td>Es war der schlimmste Aufenthalt meines Lebens...</td>\n","      <td>[Es war der schlimmste Aufenthalt meines Leben...</td>\n","      <td>0.973955</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.022492462769150734, -0.05308641120791435, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":10}]},{"cell_type":"markdown","metadata":{"id":"a1JbtmWquQwj"},"source":["# The Model understands Chinese\n","![zh](https://www.worldometers.info/img/flags/small/tn_ch-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"kYSYqtoRtc-P","executionInfo":{"status":"ok","timestamp":1620198334808,"user_tz":-300,"elapsed":2882416,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"03cb7d9c-7e27-4a88-9fa9-c9166b0b2d75"},"source":["# Chinese for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"这是我一生中最美好的时光，我喜欢它！！ \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.011552233248949051, -0.06316248327493668, -...</td>\n","      <td>great</td>\n","      <td>这是我一生中最美好的时光，我喜欢它！！</td>\n","      <td>[这是我一生中最美好的时光，我喜欢它！！]</td>\n","      <td>0.999965</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.011552233248949051, -0.06316248327493668, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":11}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"06v9SD-QtlBU","executionInfo":{"status":"ok","timestamp":1620198335872,"user_tz":-300,"elapsed":2883457,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"f0933f0f-0efe-446e-ffb3-45189853d5e9"},"source":["# Chinese for: 'It was awful!! '\n","fitted_pipe.predict(\"太糟糕了!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.025874070823192596, -0.0665956661105156, -...</td>\n","      <td>poor</td>\n","      <td>太糟糕了!!</td>\n","      <td>[太糟糕了!!]</td>\n","      <td>0.999621</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.025874070823192596, -0.0665956661105156, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":12}]},{"cell_type":"markdown","metadata":{"id":"9h7CvN4uu9Pb"},"source":["# Model understands Afrikaans\n","\n","![af](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)\n","\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"VMPhbgw9twtf","executionInfo":{"status":"ok","timestamp":1620198337259,"user_tz":-300,"elapsed":2884820,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"16a873e7-bf3f-4d4e-f28f-a488b7df7e00"},"source":["\t\t\n","#  Afrikaans for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Dit was die beste verblyf in my lewe, ek was mal daaroor !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.027523020282387733, -0.034727904945611954, ...</td>\n","      <td>great</td>\n","      <td>Dit was die beste verblyf in my lewe, ek was m...</td>\n","      <td>[Dit was die beste verblyf in my lewe, ek was ...</td>\n","      <td>0.999458</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.027523020282387733, -0.034727904945611954, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":13}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"zWgNTIdkumhX","executionInfo":{"status":"ok","timestamp":1620198338526,"user_tz":-300,"elapsed":2886068,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"ea6ff455-cb57-45db-dc5a-7dd349c4e9b7"},"source":["#  Afrikaans for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Dit was die slegste verblyf in my lewe, ek het dit gehaat !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.020533405244350433, -0.044794000685214996, ...</td>\n","      <td>poor</td>\n","      <td>Dit was die slegste verblyf in my lewe, ek het...</td>\n","      <td>[Dit was die slegste verblyf in my lewe, ek he...</td>\n","      <td>0.994397</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.020533405244350433, -0.044794000685214996, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":14}]},{"cell_type":"markdown","metadata":{"id":"rSEPkC-Bwnpg"},"source":["# The model understands Vietnamese\n","![vi](https://www.worldometers.info/img/flags/small/tn_vm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"7ksJosuTOYpE","executionInfo":{"status":"ok","timestamp":1620198339068,"user_tz":-300,"elapsed":2886589,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"c866d07f-87ab-4d52-f1b1-34e30a478dfe"},"source":["# Vietnamese for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Đó là kỳ nghỉ tuyệt vời nhất trong đời tôi, tôi yêu nó !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.022074803709983826, -0.06135039031505585, -...</td>\n","      <td>great</td>\n","      <td>Đó là kỳ nghỉ tuyệt vời nhất trong đời tôi, tô...</td>\n","      <td>[Đó là kỳ nghỉ tuyệt vời nhất trong đời tôi, t...</td>\n","      <td>0.987656</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.022074803709983826, -0.06135039031505585, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":15}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"VfG3UaCTEZB_","executionInfo":{"status":"ok","timestamp":1620198339753,"user_tz":-300,"elapsed":2887259,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"93baa7bb-1c57-462f-dcc9-82ef2aac03f2"},"source":["# Vietnamese for: 'It was awful!! '\n","fitted_pipe.predict(\"Nó quá tệ!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.011885211803019047, -0.06412354856729507, ...</td>\n","      <td>poor</td>\n","      <td>Nó quá tệ!!</td>\n","      <td>[Nó quá tệ!, !]</td>\n","      <td>0.999769</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.011885211803019047, -0.06412354856729507, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":16}]},{"cell_type":"markdown","metadata":{"id":"IlkmAaMoxTuy"},"source":["# The model understands Japanese\n","![ja](https://www.worldometers.info/img/flags/small/tn_ja-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"1IfJu3q8wwUt","executionInfo":{"status":"ok","timestamp":1620198340855,"user_tz":-300,"elapsed":2888342,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"b651a4da-8344-44bb-a076-9c287a65aa89"},"source":["# Japanese for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"それは私の人生で最高の滞在でした、私はそれを愛していました!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.03218996152281761, -0.045211367309093475, -...</td>\n","      <td>great</td>\n","      <td>それは私の人生で最高の滞在でした、私はそれを愛していました!!</td>\n","      <td>[それは私の人生で最高の滞在でした、私はそれを愛していました!!]</td>\n","      <td>0.999946</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.03218996152281761, -0.045211367309093475, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":17}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"-RjXWbFIPvIs","executionInfo":{"status":"ok","timestamp":1620198341788,"user_tz":-300,"elapsed":2889260,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"176a9c53-165c-46e8-bf12-4347064b298e"},"source":["# Japanese for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"人生最悪の滞在でした、嫌いでした!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.0015585105866193771, -0.04200108349323273, ...</td>\n","      <td>poor</td>\n","      <td>人生最悪の滞在でした、嫌いでした!!</td>\n","      <td>[人生最悪の滞在でした、嫌いでした!!]</td>\n","      <td>0.999895</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.0015585105866193771, -0.04200108349323273, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":18}]},{"cell_type":"markdown","metadata":{"id":"GITfT7FK0CGv"},"source":["# The model understands Zulu\n","![zu](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"ifRhs6e7OcR3","executionInfo":{"status":"ok","timestamp":1620198342364,"user_tz":-300,"elapsed":2889821,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"e00114d7-4b8d-4ef1-d2ba-93fa0a2cbcf5"},"source":["#  Zulu for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Kwakungukuhlala okuhle kakhulu empilweni yami, ngangikuthanda !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.020903216674923897, -0.05406734347343445, -...</td>\n","      <td>great</td>\n","      <td>Kwakungukuhlala okuhle kakhulu empilweni yami,...</td>\n","      <td>[Kwakungukuhlala okuhle kakhulu empilweni yami...</td>\n","      <td>0.999816</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.020903216674923897, -0.05406734347343445, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":19}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"6uelDwq4xdWv","executionInfo":{"status":"ok","timestamp":1620198343127,"user_tz":-300,"elapsed":2890569,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"d503e624-8998-446e-d50d-96250c5de876"},"source":["#  Zulu for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Kwakuwukuhlala okubi kakhulu empilweni yami, ngangikuzonda !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.012615696527063847, -0.05433850735425949, -...</td>\n","      <td>poor</td>\n","      <td>Kwakuwukuhlala okubi kakhulu empilweni yami, n...</td>\n","      <td>[Kwakuwukuhlala okubi kakhulu empilweni yami, ...</td>\n","      <td>0.998103</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.012615696527063847, -0.05433850735425949, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":20}]},{"cell_type":"markdown","metadata":{"id":"VGVvzl_30a0T"},"source":["# The  Model understands Turkish\n","![tr](https://www.worldometers.info/img/flags/small/tn_tu-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"DRNnuEeQz2pd","executionInfo":{"status":"ok","timestamp":1620198344168,"user_tz":-300,"elapsed":2891594,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"d6472c75-d880-4400-f766-6f16df786e56"},"source":["\n","#  Turkish for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Hayatımın en iyi kalışıydı, onu sevdim! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.01813078671693802, -0.01860048621892929, -0...</td>\n","      <td>great</td>\n","      <td>Hayatımın en iyi kalışıydı, onu sevdim!</td>\n","      <td>[Hayatımın en iyi kalışıydı, onu sevdim!]</td>\n","      <td>0.999777</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.01813078671693802, -0.01860048621892929, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":21}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"aOSsiK6J0jWs","executionInfo":{"status":"ok","timestamp":1620198345052,"user_tz":-300,"elapsed":2892459,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"dba6c1dc-5efe-4756-c067-55b0e9c45c0f"},"source":["#  Turkish for: 'It was awful!! '\n","fitted_pipe.predict(\"Berbattı!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.00401829881593585, -0.05757148563861847, -0...</td>\n","      <td>poor</td>\n","      <td>Berbattı!!</td>\n","      <td>[Berbattı!!]</td>\n","      <td>0.999184</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.00401829881593585, -0.05757148563861847, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":22}]},{"cell_type":"markdown","metadata":{"id":"803qL2gt0vlb"},"source":["#  The Model understands Hebrew\n","![he](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"XQ5VCtxw0pc0","executionInfo":{"status":"ok","timestamp":1620198345808,"user_tz":-300,"elapsed":2893201,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"f113bd48-aff7-471d-d792-d98f207442b6"},"source":["\t\t\n","# Hebrew for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"זה היה השהייה הכי טובה בחיי, אהבתי את זה !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.021775638684630394, -0.041435129940509796, ...</td>\n","      <td>great</td>\n","      <td>זה היה השהייה הכי טובה בחיי, אהבתי את זה !!</td>\n","      <td>[זה היה השהייה הכי טובה בחיי, אהבתי את זה !, !]</td>\n","      <td>0.999886</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.021775638684630394, -0.041435129940509796, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":23}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"9w2ZHfns05A4","executionInfo":{"status":"ok","timestamp":1620198346343,"user_tz":-300,"elapsed":2893722,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"5c48f33a-3123-4f1b-9558-d4f775f41795"},"source":["# Hebrew for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"זה היה השהייה הגרועה בחיי, שנאתי את זה !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.02067272923886776, -0.04731830209493637, -0...</td>\n","      <td>poor</td>\n","      <td>זה היה השהייה הגרועה בחיי, שנאתי את זה !!</td>\n","      <td>[זה היה השהייה הגרועה בחיי, שנאתי את זה !, !]</td>\n","      <td>0.994378</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.02067272923886776, -0.04731830209493637, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":24}]},{"cell_type":"markdown","metadata":{"id":"SDlpd33H1HIX"},"source":["# The Model understands Telugu\n","![te](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"Kc5n1bzv1BJT","executionInfo":{"status":"ok","timestamp":1620198347793,"user_tz":-300,"elapsed":2895149,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"f220ad9c-7148-466e-86f9-ada2c63c432d"},"source":["# Telugu for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"ఇది నా జీవితంలో ఉత్తమమైన కాలం, నేను దానిని ఇష్టపడ్డాను !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.018417486920952797, -0.05317000299692154, -...</td>\n","      <td>great</td>\n","      <td>ఇది నా జీవితంలో ఉత్తమమైన కాలం, నేను దానిని ఇష్...</td>\n","      <td>[ఇది నా జీవితంలో ఉత్తమమైన కాలం, నేను దానిని ఇష...</td>\n","      <td>0.999768</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.018417486920952797, -0.05317000299692154, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":25}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"-l-u6vrz1Obe","executionInfo":{"status":"ok","timestamp":1620198348624,"user_tz":-300,"elapsed":2895964,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"ac93039e-bc03-44c8-c68a-33232a908cad"},"source":["\t\t\n","# Telugu for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"ఇది నా జీవితంలో చెత్తగా ఉంది, నేను అసహ్యించుకున్నాను !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.0009551368420943618, -0.055933333933353424...</td>\n","      <td>poor</td>\n","      <td>ఇది నా జీవితంలో చెత్తగా ఉంది, నేను అసహ్యించుకు...</td>\n","      <td>[ఇది నా జీవితంలో చెత్తగా ఉంది, నేను అసహ్యించుక...</td>\n","      <td>0.997909</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.0009551368420943618, -0.055933333933353424...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":26}]},{"cell_type":"markdown","metadata":{"id":"nziBUe8t1Zwn"},"source":["# Model understands Russian\n","![ru](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"Ckyjl3YQ1VFn","executionInfo":{"status":"ok","timestamp":1620198349365,"user_tz":-300,"elapsed":2896690,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"dc8a0ec9-45b1-4b57-e99d-d93dc973c9fd"},"source":["#  Russian for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Это был лучший отдых в моей жизни, мне очень понравилось !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.024515425786376, -0.038578882813453674, -0....</td>\n","      <td>great</td>\n","      <td>Это был лучший отдых в моей жизни, мне очень п...</td>\n","      <td>[Это был лучший отдых в моей жизни, мне очень ...</td>\n","      <td>0.999933</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.024515425786376, -0.038578882813453674, -0....  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":27}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"GIdWkfGv1gFz","executionInfo":{"status":"ok","timestamp":1620198350023,"user_tz":-300,"elapsed":2897334,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"20d306a4-a129-4254-f790-783bcb5f096d"},"source":["#  Russian for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Это было худшее пребывание в моей жизни, я ненавидел его !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.006281793583184481, -0.03218899294734001, ...</td>\n","      <td>poor</td>\n","      <td>Это было худшее пребывание в моей жизни, я нен...</td>\n","      <td>[Это было худшее пребывание в моей жизни, я не...</td>\n","      <td>0.99909</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.006281793583184481, -0.03218899294734001, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":28}]},{"cell_type":"markdown","metadata":{"id":"8R1j9mwz2Cm4"},"source":["# Model understands Urdu\n","![ur](https://www.worldometers.info/img/flags/small/tn_pk-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"j4zwvRV11pcG","executionInfo":{"status":"ok","timestamp":1620198350894,"user_tz":-300,"elapsed":2898189,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"abd208d6-a177-43be-8cf5-10a9c519054a"},"source":["\t\t\n","# Urdu for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"یہ میری زندگی کا بہترین قیام تھا ، مجھے اس سے پیار تھا !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.016523491591215134, -0.043619364500045776, ...</td>\n","      <td>great</td>\n","      <td>یہ میری زندگی کا بہترین قیام تھا ، مجھے اس سے ...</td>\n","      <td>[یہ میری زندگی کا بہترین قیام تھا ، مجھے اس سے...</td>\n","      <td>0.99906</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.016523491591215134, -0.043619364500045776, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":29}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SxzTuK4b2UKV","executionInfo":{"status":"ok","timestamp":1620198352126,"user_tz":-300,"elapsed":2899401,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"d86aa2c7-5b93-4c26-d88c-c0f78c6d20b3"},"source":["\n","# Urdu for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"یہ میری زندگی کا بدترین قیام تھا ، مجھے اس سے نفرت تھی !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.010332365520298481, -0.032978493720293045, ...</td>\n","      <td>poor</td>\n","      <td>یہ میری زندگی کا بدترین قیام تھا ، مجھے اس سے ...</td>\n","      <td>[یہ میری زندگی کا بدترین قیام تھا ، مجھے اس سے...</td>\n","      <td>0.999414</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.010332365520298481, -0.032978493720293045, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":30}]},{"cell_type":"markdown","metadata":{"id":"RoNg-C3k1qcX"},"source":["# Model understands Hindi\n","![hi](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"QZ9RT5Wv1r1n","executionInfo":{"status":"ok","timestamp":1620198352904,"user_tz":-300,"elapsed":2900164,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"da03d122-ea78-49be-f32a-d13881ade6c6"},"source":["\n","\t\t\n","# hindi for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"यह मेरे जीवन का सबसे अच्छा प्रवास था, मुझे यह पसंद था !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.02085619606077671, -0.03468615561723709, -0...</td>\n","      <td>great</td>\n","      <td>यह मेरे जीवन का सबसे अच्छा प्रवास था, मुझे यह ...</td>\n","      <td>[यह मेरे जीवन का सबसे अच्छा प्रवास था, मुझे यह...</td>\n","      <td>0.999576</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.02085619606077671, -0.03468615561723709, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":31}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"quM-IL2i12-B","executionInfo":{"status":"ok","timestamp":1620198353928,"user_tz":-300,"elapsed":2901160,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"e9441983-11d1-40ef-a3fb-9226090f1286"},"source":["\t\t\n","# hindi for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"यह मेरे जीवन का सबसे बुरा पड़ाव था, मुझे इससे नफरत थी !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.016908325254917145, -0.031606487929821014, ...</td>\n","      <td>poor</td>\n","      <td>यह मेरे जीवन का सबसे बुरा पड़ाव था, मुझे इससे ...</td>\n","      <td>[यह मेरे जीवन का सबसे बुरा पड़ाव था, मुझे इससे...</td>\n","      <td>0.997818</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.016908325254917145, -0.031606487929821014, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":32}]},{"cell_type":"markdown","metadata":{"id":"R4ByHOZn35Lc"},"source":["# The model understands Tartar\n","![tt](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"2JrzusSQ18F5","executionInfo":{"status":"ok","timestamp":1620198354440,"user_tz":-300,"elapsed":2901648,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"b6dbc736-7f45-4f3f-a6e9-f8670e104cee"},"source":["# Tartar for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Бу минем тормышымның иң яхшы торышы иде, мин аны яраттым !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.03618491441011429, -0.039926089346408844, -...</td>\n","      <td>great</td>\n","      <td>Бу минем тормышымның иң яхшы торышы иде, мин а...</td>\n","      <td>[Бу минем тормышымның иң яхшы торышы иде, мин ...</td>\n","      <td>0.998828</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.03618491441011429, -0.039926089346408844, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":33}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"J06Xm_Ln4AYu","executionInfo":{"status":"ok","timestamp":1620198355266,"user_tz":-300,"elapsed":2902464,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"41025457-6042-43d2-a59d-7f5bf8473b0d"},"source":["# Tartar for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Бу минем тормышымның иң начар торышы иде, мин аны нәфрәт иттем !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.02321663685142994, -0.029130201786756516, -...</td>\n","      <td>poor</td>\n","      <td>Бу минем тормышымның иң начар торышы иде, мин ...</td>\n","      <td>[Бу минем тормышымның иң начар торышы иде, мин...</td>\n","      <td>0.997359</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.02321663685142994, -0.029130201786756516, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":34}]},{"cell_type":"markdown","metadata":{"id":"HKj5yWwwMplH"},"source":["# The Model understands French\n","![fr](https://www.worldometers.info/img/flags/small/tn_fr-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"CUHcJZfJMplL","executionInfo":{"status":"ok","timestamp":1620198356607,"user_tz":-300,"elapsed":2903761,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"fb255bf5-95c1-4294-d356-d29b9fa01a6f"},"source":["# French for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"C'était le meilleur séjour de ma vie, j'ai adoré !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.01606627181172371, -0.04228140786290169, -0...</td>\n","      <td>great</td>\n","      <td>C'était le meilleur séjour de ma vie, j'ai ado...</td>\n","      <td>[C'était le meilleur séjour de ma vie, j'ai ad...</td>\n","      <td>0.999963</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.01606627181172371, -0.04228140786290169, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":35}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"57NY2XoTMplM","executionInfo":{"status":"ok","timestamp":1620198357772,"user_tz":-300,"elapsed":2904893,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"a3438d73-be2b-4062-a530-9c24e50552c1"},"source":["# French for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"C'était le pire séjour de ma vie, je l'ai détesté !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.01693568006157875, -0.04099532589316368, -0...</td>\n","      <td>poor</td>\n","      <td>C'était le pire séjour de ma vie, je l'ai déte...</td>\n","      <td>[C'était le pire séjour de ma vie, je l'ai dét...</td>\n","      <td>0.993391</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.01693568006157875, -0.04099532589316368, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":36}]},{"cell_type":"markdown","metadata":{"id":"jD2TBgT0Nq6F"},"source":["# The Model understands Thai\n","![th](https://www.worldometers.info/img/flags/small/tn_th-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"gBp11S5GNq6S","executionInfo":{"status":"ok","timestamp":1620198358335,"user_tz":-300,"elapsed":2905437,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"9923f5b0-b87b-4a8d-f724-40686380863f"},"source":["\t\t\n","# Thai for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"เป็นการพักที่ดีที่สุดในชีวิตฉันชอบมาก !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.009586114436388016, -0.03715920448303223, ...</td>\n","      <td>great</td>\n","      <td>เป็นการพักที่ดีที่สุดในชีวิตฉันชอบมาก !!</td>\n","      <td>[เป็นการพักที่ดีที่สุดในชีวิตฉันชอบมาก !!]</td>\n","      <td>0.99977</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.009586114436388016, -0.03715920448303223, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":37}]},{"cell_type":"code","metadata":{"id":"R6nKI7C3QKa3","colab":{"base_uri":"https://localhost:8080/","height":80},"executionInfo":{"status":"ok","timestamp":1620198359199,"user_tz":-300,"elapsed":2906273,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"7182a070-f20d-4fcf-8f41-e81e8bddeefa"},"source":["\t\t\n","# Thai for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"เป็นการพักที่แย่ที่สุดในชีวิตฉันเกลียดมัน !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.017850901931524277, -0.04203420504927635, ...</td>\n","      <td>poor</td>\n","      <td>เป็นการพักที่แย่ที่สุดในชีวิตฉันเกลียดมัน !!</td>\n","      <td>[เป็นการพักที่แย่ที่สุดในชีวิตฉันเกลียดมัน !!]</td>\n","      <td>0.995932</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.017850901931524277, -0.04203420504927635, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":38}]},{"cell_type":"markdown","metadata":{"id":"mLItI4KZOElB"},"source":["# The Model understands Khmer\n","![km](https://www.worldometers.info/img/flags/small/tn_cb-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SWbqMgAwOElC","executionInfo":{"status":"ok","timestamp":1620198359905,"user_tz":-300,"elapsed":2906957,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"4237cadb-40f2-447c-c4a5-2d4deb1d2e26"},"source":["# Khmer for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"វាជាការស្នាក់នៅដ៏ល្អបំផុតក្នុងជីវិតខ្ញុំស្រឡាញ់វាណាស់ !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.005058396607637405, -0.05372818931937218, -...</td>\n","      <td>great</td>\n","      <td>វាជាការស្នាក់នៅដ៏ល្អបំផុតក្នុងជីវិតខ្ញុំស្រឡាញ...</td>\n","      <td>[វាជាការស្នាក់នៅដ៏ល្អបំផុតក្នុងជីវិតខ្ញុំស្រឡា...</td>\n","      <td>0.999139</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.005058396607637405, -0.05372818931937218, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":39}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"beoCtm4xQf2P","executionInfo":{"status":"ok","timestamp":1620198360466,"user_tz":-300,"elapsed":2907497,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"283ec20e-a215-4472-9365-c7c48736114c"},"source":["# Khmer for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"វាជាការស្នាក់នៅដ៏អាក្រក់បំផុតក្នុងជីវិតខ្ញុំស្អប់វាណាស់ !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[-0.01400111336261034, -0.046681344509124756, ...</td>\n","      <td>poor</td>\n","      <td>វាជាការស្នាក់នៅដ៏អាក្រក់បំផុតក្នុងជីវិតខ្ញុំស្...</td>\n","      <td>[វាជាការស្នាក់នៅដ៏អាក្រក់បំផុតក្នុងជីវិតខ្ញុំស...</td>\n","      <td>0.999332</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [-0.01400111336261034, -0.046681344509124756, ...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":40}]},{"cell_type":"markdown","metadata":{"id":"lvE-LbNiPoBT"},"source":["# The Model understands Yiddish\n","![yi](https://www.worldometers.info/img/flags/small/tn_pl-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"sZlmLhajPoBb","executionInfo":{"status":"ok","timestamp":1620198361579,"user_tz":-300,"elapsed":2908595,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"27cfc11e-7e79-42b3-c39d-1992ca0855f9"},"source":["\t\t\n","# Yiddish for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"דאָס איז געווען דער בעסטער בלייַבן פון מיין לעבן, איך ליב געהאט עס !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.01637679524719715, -0.04827779904007912, -0...</td>\n","      <td>great</td>\n","      <td>דאָס איז געווען דער בעסטער בלייַבן פון מיין לע...</td>\n","      <td>[דאָס איז געווען דער בעסטער בלייַבן פון מיין ל...</td>\n","      <td>0.998573</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.01637679524719715, -0.04827779904007912, -0...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":41}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"5h-pha_nPoBc","executionInfo":{"status":"ok","timestamp":1620198362114,"user_tz":-300,"elapsed":2909105,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"7b459f77-1a83-4dbe-dc60-8aaee2eca6a8"},"source":["# Yiddish for: 'It was awful!! '\n","fitted_pipe.predict(\"עס איז געווען שרעקלעך !! \")\n","\t\t"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.00014696447760798037, -0.05793645977973938,...</td>\n","      <td>poor</td>\n","      <td>עס איז געווען שרעקלעך !!</td>\n","      <td>[עס איז געווען שרעקלעך !!]</td>\n","      <td>0.995981</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.00014696447760798037, -0.05793645977973938,...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":42}]},{"cell_type":"markdown","metadata":{"id":"XSz4WzScaAHj"},"source":["# The Model understands Kygrgyz\n","![ky](https://www.worldometers.info/img/flags/small/tn_kg-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"DXz6fhJSaAHu","executionInfo":{"status":"ok","timestamp":1620198362814,"user_tz":-300,"elapsed":2909788,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"862885ed-dc41-4120-acad-b98752927b28"},"source":["\n","# Kygrgyz for: 'It was the best stay of my life, I loved it!!'\n","fitted_pipe.predict(\"Бул менин жашоомдогу эң жакшы жашоо болду, мен аны жакшы көрчүмүн !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.03286881372332573, -0.046127691864967346, -...</td>\n","      <td>great</td>\n","      <td>Бул менин жашоомдогу эң жакшы жашоо болду, мен...</td>\n","      <td>[Бул менин жашоомдогу эң жакшы жашоо болду, ме...</td>\n","      <td>0.99892</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.03286881372332573, -0.046127691864967346, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":43}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":97},"id":"lh_ZSHlPaAHv","executionInfo":{"status":"ok","timestamp":1620198363774,"user_tz":-300,"elapsed":2910734,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"25d6c89e-4e7f-4c80-c109-5fd10b2ec646"},"source":["# Kygrgyz for: 'It was the worst stay of my life, I hated it!!'\n","fitted_pipe.predict(\"Бул менин жашоомдогу эң жаман калуу болду, мен аны жек көрдүм !! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_labse</th>\n","      <th>trained_classifier</th>\n","      <th>document</th>\n","      <th>sentence</th>\n","      <th>trained_classifier_confidence_confidence</th>\n","      <th>origin_index</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[0.023127034306526184, -0.04409907013177872, -...</td>\n","      <td>poor</td>\n","      <td>Бул менин жашоомдогу эң жаман калуу болду, мен...</td>\n","      <td>[Бул менин жашоомдогу эң жаман калуу болду, ме...</td>\n","      <td>0.998581</td>\n","      <td>0</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence_embedding_labse  ... origin_index\n","0  [0.023127034306526184, -0.04409907013177872, -...  ...            0\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":44}]},{"cell_type":"markdown","metadata":{"id":"2BB-NwZUoHSe"},"source":["# 5. Lets save the model"]},{"cell_type":"code","metadata":{"id":"eLex095goHwm","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620199174424,"user_tz":-300,"elapsed":3721344,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"51d06cab-b03f-4958-ace7-a18747ab13a4"},"source":["stored_model_path = './models/classifier_dl_trained' \n","fitted_pipe.save(stored_model_path)"],"execution_count":null,"outputs":[{"output_type":"stream","text":["Stored model in ./models/classifier_dl_trained\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"e_b2DPd4rCiU"},"source":["# 6. Lets load the model from HDD.\n","This makes Offlien NLU usage possible!   \n","You need to call nlu.load(path=path_to_the_pipe) to load a model/pipeline from disk."]},{"cell_type":"code","metadata":{"id":"SO4uz45MoRgp","colab":{"base_uri":"https://localhost:8080/","height":80},"executionInfo":{"status":"ok","timestamp":1620199461885,"user_tz":-300,"elapsed":128907,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"56d69686-c2e0-4c0c-8577-c5811ad855ab"},"source":["stored_model_path = './models/classifier_dl_trained' \n","hdd_pipe = nlu.load(path=stored_model_path)\n","\n","preds = hdd_pipe.predict('It was a good experince!')\n","preds"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence_embedding_from_disk</th>\n","      <th>from_disk_confidence_confidence</th>\n","      <th>sentence</th>\n","      <th>text</th>\n","      <th>origin_index</th>\n","      <th>from_disk</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[[0.059547893702983856, -0.039290569722652435,...</td>\n","      <td>[0.99978]</td>\n","      <td>[It was a good experince!]</td>\n","      <td>It was a good experince!</td>\n","      <td>8589934592</td>\n","      <td>[great]</td>\n","      <td>It was a good experince!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                        sentence_embedding_from_disk  ...                  document\n","0  [[0.059547893702983856, -0.039290569722652435,...  ...  It was a good experince!\n","\n","[1 rows x 7 columns]"]},"metadata":{"tags":[]},"execution_count":1}]},{"cell_type":"code","metadata":{"id":"e0CVlkk9v6Qi","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620199462950,"user_tz":-300,"elapsed":1055,"user":{"displayName":"Gammer Otaku","photoUrl":"","userId":"18042713576744284398"}},"outputId":"6dd1bf2a-b862-413c-a4cb-d3870b6613b5"},"source":["hdd_pipe.print_info()"],"execution_count":null,"outputs":[{"output_type":"stream","text":["The following parameters are configurable for this NLU pipeline (You can copy paste the examples) :\n",">>> pipe['document_assembler'] has settable params:\n","pipe['document_assembler'].setCleanupMode('shrink')                   | Info: possible values: disabled, inplace, inplace_full, shrink, shrink_full, each, each_full, delete_full | Currently set to : shrink\n",">>> pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'] has settable params:\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setExplodeSentences(False)  | Info: whether to explode each sentence into a different row, for better parallelization. Defaults to false. | Currently set to : False\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setStorageRef('SentenceDetectorDLModel_c83c27f46b97')  | Info: storage unique identifier | Currently set to : SentenceDetectorDLModel_c83c27f46b97\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setEncoder(com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@2fc02b14)  | Info: Data encoder | Currently set to : com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@2fc02b14\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setImpossiblePenultimates(['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e'])  | Info: Impossible penultimates | Currently set to : ['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e']\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setModelArchitecture('cnn')  | Info: Model architecture (CNN) | Currently set to : cnn\n",">>> pipe['bert_sentence@labse'] has settable params:\n","pipe['bert_sentence@labse'].setBatchSize(8)                           | Info: Size of every batch | Currently set to : 8\n","pipe['bert_sentence@labse'].setCaseSensitive(False)                   | Info: whether to ignore case in tokens for embeddings matching | Currently set to : False\n","pipe['bert_sentence@labse'].setDimension(768)                         | Info: Number of embedding dimensions | Currently set to : 768\n","pipe['bert_sentence@labse'].setMaxSentenceLength(128)                 | Info: Max sentence length to process | Currently set to : 128\n","pipe['bert_sentence@labse'].setIsLong(False)                          | Info: Use Long type instead of Int type for inputs buffer - Some Bert models require Long instead of Int. | Currently set to : False\n","pipe['bert_sentence@labse'].setStorageRef('labse')                    | Info: unique reference name for identification | Currently set to : labse\n",">>> pipe['classifier_dl@labse'] has settable params:\n","pipe['classifier_dl@labse'].setClasses(['average', 'great', 'poor'])  | Info: get the tags used to trained this ClassifierDLModel | Currently set to : ['average', 'great', 'poor']\n","pipe['classifier_dl@labse'].setStorageRef('labse')                    | Info: unique reference name for identification | Currently set to : labse\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"c4Z3pq6jZ-m-"},"source":[""],"execution_count":null,"outputs":[]}]}